Robust audiovisual speech recognition using noise-adaptive linear discriminant analysis

© 2016 IEEE.Automatic speech recognition (ASR) has become a widespread and convenient mode of human-machine interaction, but it is still not sufficiently reliable when used under highly noisy or reverberant conditions. One option for achieving far greater robustness is to include another modality that is unaffected by acoustic noise, such as video information. Currently the most successful approaches for such audiovisual ASR systems, coupled hidden Markov models (HMMs) and turbo decoding, both allow for slight asynchrony between audio and video features, and significantly improve recognition rates in this way. However, both typically still neglect residual errors in the estimation of audio features, so-called observation uncertainties. This paper compares two strategies for adding these observation uncertainties into the decoder, and shows that significant recognition rate improvements are achievable for both coupled HMMs and turbo decoding

Improving audio-visual speech recognition using deep neural networks with dynamic stream reliability estimates

Audio-visual speech recognition is a promising approach to tackling the problem of reduced recognition rates under adverse acoustic conditions. However, finding an optimal mechanism for combining multi-modal information remains a challenging task. Various methods are applicable for integrating acoustic and visual information in Gaussian-mixture-model-based speech recognition, e.g., via dynamic stream weighting. The recent advances of deep neural network (DNN)-based speech recognition promise improved performance when using audio-visual information. However, the question of how to optimally integrate acoustic and visual information remains. In this paper, we propose a state-based integration scheme that uses dynamic stream weights in DNN-based audio-visual speech recognition. The dynamic weights are obtained from a time-variant reliability estimate that is derived from the audio signal. We show that this state-based integration is superior to early integration of multi-modal features, even if early integration also includes the proposed reliability estimate. Furthermore, the proposed adaptive mechanism is able to outperform a fixed weighting approach that exploits oracle knowledge of the true signal-to-noise ratio

Binaural sound source localisation using a Bayesian-network-based blackboard system and hypothesis-driven feedback

An essential aspect of Auditory Scene Analysis is the localisation of sound sources in relation to the position of the listener in the surrounding environment. The human auditory system is capable of precisely locating and separating different sound sources, even in noisy and reverberant environments, whereas mimicking this ability by computational means is still a challenging task. In this work, we investigate a Bayesian-network-based approach in the context of binaural sound source localisation. We extend existing solutions towards a Bayesian network based blackboard system that includes expert knowledge inspired by insights into the human auditory system. In order to improve estimation of source positions and reduce uncertainty caused by front-back ambiguities, hypothesis-driven feedback is used. This is accomplished by triggering head movements based on inference results provided by the Bayesian network. We evaluate the performance of our approach in comparison to existing solutions in a sound-source localisation task within a virtual acoustic environment

BLUES from Music: BLind Underdetermined Extraction of Sources from Music

In this paper we propose to use an instantaneous ICA method (BLUES) to separate the instruments in a real music stereo recording. We combine two strong separation techniques to segregate instruments from a mixture: ICA and binary time-frequency masking. By combining the methods, we are able to make use of the fact that the sources are differently distributed in both space, time and frequency. Our method is able to segregate an arbitrary number of instruments and the segregated sources are maintained as stereo signals. We have evaluated our method on real stereo recordings, and we can segregate instruments which are spatially different from other instruments

PFAS levels and determinants of variability in exposure in European teenagers - Results from the HBM4EU aligned studies (2014-2021)

Background: Perfluoroalkyl substances (PFAS) are man-made fluorinated chemicals, widely used in various types of consumer products, resulting in their omnipresence in human populations. The aim of this study was to describe current PFAS levels in European teenagers and to investigate the determinants of serum/plasma concentrations in this specific age group. Methods: PFAS concentrations were determined in serum or plasma samples from 1957 teenagers (12-18 years) from 9 European countries as part of the HBM4EU aligned studies (2014-2021). Questionnaire data were post-harmonized by each study and quality checked centrally. Only PFAS with an overall quantification frequency of at least 60% (PFOS, PFOA, PFHxS and PFNA) were included in the analyses. Sociodemographic and lifestyle factors were analysed together with food consumption frequencies to identify determinants of PFAS exposure. The variables study, sex and the highest educational level of household were included as fixed factors in the multivariable linear regression models for all PFAS and each dietary variable was added to the fixed model one by one and for each PFAS separately. Results: The European exposure values for PFAS were reported as geometric means with 95% confidence intervals (CI): PFOS [2.13 μg/L (1.63-2.78)], PFOA ([0.97 μg/L (0.75-1.26)]), PFNA [0.30 μg/L (0.19-0.45)] and PFHxS [0.41 μg/L (0.33-0.52)]. The estimated geometric mean exposure levels were significantly higher in the North and West versus the South and East of Europe. Boys had significantly higher concentrations of the four PFAS compared to girls and significantly higher PFASs concentrations were found in teenagers from households with a higher education level. Consumption of seafood and fish at least 2 times per week was significantly associated with 21% (95% CI: 12-31%) increase in PFOS concentrations and 20% (95% CI: 10-31%) increase in PFNA concentrations as compared to less frequent consumption of seafood and fish. The same trend was observed for PFOA and PFHxS but not statistically significant. Consumption of eggs at least 2 times per week was associated with 11% (95% CI: 2-22%) and 14% (95% CI: 2-27%) increase in PFOS and PFNA concentrations, respectively, as compared to less frequent consumption of eggs. Significantly higher PFOS concentrations were observed for participants consuming offal (14% (95% CI: 3-26%)), the same trend was observed for the other PFAS but not statistically significant. Local food consumption at least 2 times per week was associated with 40% (95% CI: 19-64%) increase in PFOS levels as compared to those consuming local food less frequently. Conclusion: This work provides information about current levels of PFAS in European teenagers and potential dietary sources of exposure to PFAS in European teenagers. These results can be of use for targeted monitoring of PFAS in food.This work was supported by the European Union’s Horizon 2020 research and innovation programme under Grant agreement No 733032 HBM4EU (www.HBM4EU.eu), and received co-funding from the authors’ organizations: Riksmaten Adolescents: Riksmaten Adolescents was performed by the Swedish Food Agency with financial support from the Swedish Environmental Protection Agency and the Swedish Civil Contingencies Agency. NEB II: The Norwegian Institute of Public Health (NIPH) has contributed to funding of the Norwegian Environmental Biobank (NEB). The laboratory measurements have partly been funded by the Research Council of Norway through research projects (275903 and 268465) PCB cohort follow-up: PCB cohort follow-up received additional funding from the Ministry of Health of the Slovak Republic, program 07B0103. BEA: BEA study was funded by the Spanish Ministry of Agriculture, Fisheries and Food and the Instituto de Salud Carlos III (SEG 1321/15) SLO-CRP: The Slovenian SLO-CRP study was co-financed by the Jozef Stefan Institute program P1- 0143, and a national project “Exposure of children and adolescents to selected chemicals through their habitat environment” (grant agreement No. C2715-16-634802). CROME: CROME study was co-funded by the European Commission research funds of Horizon 2020. ESTEBAN: ESTEBAN study was funded by Santé Publique France and the French ministries of Health and the Environment. GerES V-sub: The funding of the German Ministry for the Environment, Nature Conservation, Nuclear Safety and Consumer Protection is gratefully acknowledged. FLEHS IV: The Flemish Center of Expertise on Environment and Health is funded by the Government of Flanders, Department of Environment & Spatial Development.S

Time Trends of Acrylamide Exposure in Europe: Combined Analysis of Published Reports and Current HBM4EU Studies

More than 20 years ago, acrylamide was added to the list of potential carcinogens found in many common dietary products and tobacco smoke. Consequently, human biomonitoring studies investigating exposure to acrylamide in the form of adducts in blood and metabolites in urine have been performed to obtain data on the actual burden in different populations of the world and in Europe. Recognizing the related health risk, the European Commission responded with measures to curb the acrylamide content in food products. In 2017, a trans-European human biomonitoring project (HBM4EU) was started with the aim to investigate exposure to several chemicals, including acrylamide. Here we set out to provide a combined analysis of previous and current European acrylamide biomonitoring study results by harmonizing and integrating different data sources, including HBM4EU aligned studies, with the aim to resolve overall and current time trends of acrylamide exposure in Europe. Data from 10 European countries were included in the analysis, comprising more than 5500 individual samples (3214 children and teenagers, 2293 adults). We utilized linear models as well as a non-linear fit and breakpoint analysis to investigate trends in temporal acrylamide exposure as well as descriptive statistics and statistical tests to validate findings. Our results indicate an overall increase in acrylamide exposure between the years 2001 and 2017. Studies with samples collected after 2018 focusing on adults do not indicate increasing exposure but show declining values. Regional differences appear to affect absolute values, but not the overall time-trend of exposure. As benchmark levels for acrylamide content in food have been adopted in Europe in 2018, our results may imply the effects of these measures, but only indicated for adults, as corresponding data are still missing for children

Approaches to mixture risk assessment of PFASs in the European population based on human hazard and biomonitoring data

Per- and polyfluoroalkyl substances (PFASs) are a highly persistent, mobile, and bioaccumulative class of chemicals, of which emissions into the environment result in long-lasting contamination with high probability for causing adverse effects to human health and the environment. Within the European Biomonitoring Initiative HBM4EU, samples and data were collected in a harmonized way from human biomonitoring (HBM) studies in Europe to derive current exposure data across a geographic spread. We performed mixture risk assessments based on recent internal exposure data of PFASs in European teenagers generated in the HBM4EU Aligned Studies (dataset with N = 1957, sampling years 2014-2021). Mixture risk assessments were performed based on three hazard-based approaches: the Hazard Index (HI) approach, the sum value approach as used by the European Food Safety Authority (EFSA) and the Relative Potency Factor (RPF) approach. The HI approach resulted in the highest risk estimates, followed by the RPF approach and the sum value approach. The assessments indicate that PFAS exposure may result in a health risk in a considerable fraction of individuals in the HBM4EU teenager study sample, thereby confirming the conclusion drawn in the recent EFSA scientific opinion. This study underlines that HBM data are of added value in assessing the health risks of aggregate and cumulative exposure to PFASs, as such data are able to reflect exposure from different sources and via different routes.This work was supported by the European Union’s Horizon 2020 research and innovation programme under Grant agreement No 733032 HBM4EU (www.HBM4EU.eu), and received co-funding from the au thors’ organizations. The Norwegian Institute of Public Health (NIPH) has contributed to funding of the Norwegian Environmental Biobank (NEB), and the laboratory measurements have partly been funded by the Research Council of Norway through research projects (275903 and 268465). The PCB cohort (follow-up) received additional funding from the Ministry of Health of the Slovak Republic (program 07B0103).S

A walk in the PARC:developing and implementing 21st century chemical risk assessment in Europe

Current approaches for the assessment of environmental and human health risks due to exposure to chemical substances have served their purpose reasonably well. Nevertheless, the systems in place for different uses of chemicals are faced with various challenges, ranging from a growing number of chemicals to changes in the types of chemicals and materials produced. This has triggered global awareness of the need for a paradigm shift, which in turn has led to the publication of new concepts for chemical risk assessment and explorations of how to translate these concepts into pragmatic approaches. As a result, next-generation risk assessment (NGRA) is generally seen as the way forward. However, incorporating new scientific insights and innovative approaches into hazard and exposure assessments in such a way that regulatory needs are adequately met has appeared to be challenging. The European Partnership for the Assessment of Risks from Chemicals (PARC) has been designed to address various challenges associated with innovating chemical risk assessment. Its overall goal is to consolidate and strengthen the European research and innovation capacity for chemical risk assessment to protect human health and the environment. With around 200 participating organisations from all over Europe, including three European agencies, and a total budget of over 400 million euro, PARC is one of the largest projects of its kind. It has a duration of seven years and is coordinated by ANSES, the French Agency for Food, Environmental and Occupational Health & Safety